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DESCRIPTION 



INFORMATION CODING APPARATUS, INFORMATION DECODING 
APPARATUS, AND METHOD AND PROGRAM FOR THE SAME 



Technical Field 

[0001] The present invention relates to an information coding 
apparatus, an information decoding apparatus, and a method and program for 
the same, which are used for optical information recording and reproduction. 

[0002] Priority is claimed on Japanese Patent Application No. 2003- 
104048, filed April 8, 2003, the content of which is incorporated herein by 
reference. 



Background Art 

[0003] In the past, for recording information upon a recording 
medium such as a holographic memory or the like, first the information which 
is to be recorded is coded into a two-dimensional image, and then this 
information, coded in the two-dimensional image, is recorded upon a 
recording medium (a recording material) by using a laser beam or the like as 
a signal beam or a reference beam. 

[0004] The original information is then reproduced by, for example, 
decoding a two-dimensional image which has been obtained by an imaging 
device by using a laser light beam or the like as a reference beam. 
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[0005] As a method of representing information two-dimensionally in 
this manner, there is an information coding method of representing 2 bit 
information by 4 x 4 pixels (refer to Japanese Unexamined Patent Application, 
First Publication No. 2002-366014 - hereinafter termed Patent Document #1). 

5 Furthermore, there is a distortion compensation method of compensating the 
size of an image which has been detected back to the original image size 
(refer to Japanese Unexamined Patent Application, First Publication No. 
2003-78746 - hereinafter termed Patent Document #2). 

[0006] As is described in these documents, normally, it is often the 

10 case that the information is recorded as a binary image made up from black 
and white. Furthermore, the reproduction of the information which has been 
recorded is performed by capturing an image with an imaging device such as 
a CCD (Charge Coupled Device) camera or the like, and by thus reading out 
the information which is recorded. 

15 [0007] When representing information by a two-dimensional image in 

this manner, if the two-dimensional image is represented as a binary image 
made up from black and white, the amount of information which can be 
represented in a two-dimensional image of a given size is, at the maximum, 
the number of bits corresponding to the number of pixels in that image. 

20 [0008] However, since during reproduction the image is captured 

with an imaging device such as a CCD camera or the like, the pixels of the 
CCD camera and the pixels of the recorded image deviate from one another, 
and hence it may happen that the information is not properly read out. 
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Therefore, in practice it is difficult to represent one bit of information with one 

pixel of the CCD camera. 

[0009] For example, if a white, a black, a white, and a black pixel are 

present in that order along a line in the recorded image, then, if this image is 
5 captured by the CCD camera in a state in which it has deviated by exactly 0.5 

of a pixel, a gray color, which is a color between white and black, is obtained 

at a CCD pixel which is positioned between a white pixel and a black pixel. 

Thus, the line consists of a gray, a gray, and a gray pixel is obtained, so that it 

has become impossible to extract the original information. In other words, 
10 when information which is meaningful is arranged at the pixel pitch of the 

imaging device, it becomes difficult to read it out due to the influence of 

positional deviation and the like. 

[0010] Furthermore, as a method of solving this problem, Patent 

Document #1 proposes a coding method in which two bits of information are 
15 represented by 4 x 4 pixels. However, since this method represents 2 bits by 

16 pixels, the coding rate is 1/8, and thus there is the problem that the amount 

of information which can be recorded is low. 

Disclosure of Invention 
20 [0011] The present invention has been made in the light of the above 

circumstances, and its object is to provide an information coding apparatus, 
an information decoding apparatus, and a method and program for the same, 
which can represent a large amount of information with a small number of 
pixels. 
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[0012] This invention is made in order to solve the above-described 
problems; and an information coding apparatus according to the present 
invention comprises a code block conversion unit which codes information bits 
which are inputted as a block of a two-dimensional image made up from m 
5 (where m is a natural number) x n (where n is a natural number) pixels, 
wherein the code block conversion unit arranges pixels which represent the 
information bits in a code area, which is an area of (m - o) x (n - p) pixels 
within a code block of m x n pixels (where o and p are natural numbers which 
satisfy 0<o<m and 0<p<n); and arranges no pixels which represent the 

10 information bits in a guide area, which is an area of the other pixels within the 
code block of m x n pixels. 

[0013] Furthermore, an information coding apparatus according to 
the present invention comprises a code block conversion unit which codes 
information bits which are inputted as a block of a two-dimensional image 

15 made up from m (where m is a natural number) x n (where n is a natural 

number) pixels, wherein the code block conversion unit arranges pixels which 
represent the information bits in a code area, which is an area of (m - o) x (n - 
p) pixels within a code block of m x n pixels (where o and p are natural 
numbers which satisfy 0<o<m and 0<p<n); and arranges pixels which 

20 represent predetermined information bits in a guide area, which is an area of 
the other pixels within the code block of m x n pixels. 

[0014] Furthermore, in the above-described information coding 
apparatuses, the code block conversion unit may determine the size and the 
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position of a pixel which is arranged in the area of (m - o) x (n - p) pixels, 
based upon the size of the area of (m - o) x (n - p) pixels. 

[0015] Furthermore, an information decoding apparatus according to 
the present invention comprises: a code pattern estimation unit which 
5 receives input of a photographed image which has been obtained by 

photographing a two-dimensional image which consists of an area of m x n 
pixels, in which a single code block comprises a code area in which (m - o) x 
(n - p) pixels which represent information bits (where m and n are natural 
numbers, and o and p are natural numbers which satisfy 0<o<m and 0<p<n) 

10 are arranged, and a guide area in which no pixels which represent the 

information bits are arranged, and which estimates a pattern of the code block 
based upon the result of relative comparison between the photographed 
image and images in an ideal state; and a bit string reconstruction unit which 
decodes the information bits of the photographed image which is inputted 

15 based upon the result of the estimation of the pattern. 

[0016] Furthermore, in the above-described information decoding 
apparatus, there may be further included: a positional deviation amount 
detection unit which detects an amount of positional deviation between pixels 
of the two-dimensional image and pixels of the photographed image; an ideal 

20 photographed image calculation unit which calculates ideal photographed 
images of code blocks corresponding to code patterns based upon the 
amount of positional deviation which has been detected; and an image 
comparison unit which compares together the photographed image which is 
inputted and the ideal photographed images which have been calculated, and 
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calculates relative values, and wherein the code pattern estimation unit 
estimates the pattern of the code block from the relative values which have 
been calculated. 

[0017] Furthermore, in the above-described information decoding 

5 apparatus, there may be further included: a positional deviation amount 

detection unit which detects an amount of positional deviation between pixels 
of the two-dimensional image and pixels of a photographed image; an ideal 
photographed image calculation unit which calculates ideal photographed 
images of code blocks corresponding to code patterns based upon the 

10 amount of positional deviation which has been detected; an ideal 

reconstructed image calculation unit which calculates ideal reconstructed 
images of code blocks based upon the ideal photographed images which 
have been calculated, and the amount of positional deviation which has been 
detected; a reconstructed image calculation unit which calculates a 

15 reconstructed image of the two-dimensional image from the photographed 
image, based upon the amount of positional deviation which has been 
detected; and an image comparison unit which compares together the 
reconstructed image which has been calculated from the photographed image 
and the reconstructed images which have been calculated from the code 

20 blocks, and calculates relative values, and wherein the code pattern 

estimation unit may estimate the pattern of the code block from the relative 
values which have been calculated. 

[0018] Furthermore, an information coding method according to the 
present invention codes information bits which are inputted as a block of a 
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two-dimensional image made up from m (where m is a natural number) x n 
(where n is a natural number) pixels, and the method comprises the steps of: 
arranging pixels which represent the information bits in a code area, which is 
an area of (m - o) x (n - p) pixels within a code block of m x n pixels (where o 
5 and p are natural numbers which satisfy 0<o<m and 0<p<n); and arranging no 
pixels which represent the information bits in a guide area, which is an area of 
the other pixels within the code block of m x n pixels. 

[0019] Furthermore, an information coding method according to the 
present invention codes information bits which are inputted as a block of a 

10 two-dimensional image made up from m (where m is a natural number) x n 
(where n is a natural number) pixels, and the method comprises the steps of: 
arranging pixels which represent the information bits in a code area, which is 
an area of (m - o) x (n - p) pixels within a code block of m x n pixels (where o 
and p are natural numbers which satisfy 0<o<m and 0<p<n), and arranging 

15 pixels which represent predetermined information bits in a guide area, which 
is an area of the other pixels within the code block of m x n pixels. 

[0020] Furthermore, in the above-described information coding 
methods, the size and the position of a pixel which is arranged in the area of 
(m - o) x (n - p) pixels may be determined based upon the size of the area of 

20 (m - o) x (n - p) pixels. 

[0021] Furthermore, the information decoding method according to 
the present invention comprises the steps of: receiving input of a 
photographed image which has been obtained by photographing a two- 
dimensional image which consists of an area of m x n pixels, in which a single 
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code block comprises a code area in which (m - o) x (n - p) pixels which 
represent information bits (where m and n are natural numbers, and o and p 
are natural numbers which satisfy 0<o<m and 0<p<n) are arranged, and a 
guide area in which no pixels which represent the information bits are 
5 arranged; estimating a pattern of the code block based upon the result of 
relative comparison between the photographed image and images in an ideal 
state; and decoding the information bits of the photographed image which is 
inputted based upon the result of the estimation of the pattern. 

[0022] Furthermore, the above-described information decoding 

10 method may further comprise the steps of: detecting an amount of positional 
deviation between pixels of the two-dimensional image and pixels of the 
photographed image; calculating ideal photographed images of code blocks 
corresponding to code patterns based upon the amount of positional deviation 
which has been detected; comparing together the photographed image which 

15 is inputted and the ideal photographed images which have been calculated, 
and calculating relative values; and estimating the pattern of the code block 
from the relative values which have been calculated. 

[0023] Furthermore, the above-described information decoding 
method may further comprise the steps of: detecting an amount of positional 

20 deviation between pixels of the two-dimensional image and pixels of the 

photographed image; calculating ideal photographed images of code blocks 
corresponding to code patterns based upon the amount of positional deviation 
which has been detected; calculating ideal reconstructed images of code 
blocks based upon the ideal photographed images which have been 
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calculated, and the amount of positional deviation which has been detected; 
calculating a reconstructed image of the two-dimensional image from the 
photographed image based upon the amount of positional deviation which has 
been detected; comparing together the reconstructed image which has been 
5 calculated from the photographed image and the reconstructed images which 
have been calculated from the code blocks, and calculating relative values; 
and estimating the pattern of the code block from the relative values which 
have been calculated. 

[0024] An information coding program according to the present 

10 invention is an information coding program which causes a computer to 

execute a coding process of coding information bits which are inputted as a 
block of a two-dimensional image made up from m (where m is a natural 
number) x n (where n is a natural number) pixels, the coding process 
comprising the steps of: arranging pixels which represent the information bits 

15 in a code area, which is an area of (m - o) x (n - p) pixels within a code block 
of m x n pixels (where o and p are natural numbers which satisfy 0<o<m and 
0<p<n); and arranging no pixels which represent the information bits in a 
guide area, which is an area of the other pixels within the code block of m x n 
pixels. 

20 [0025] Furthermore, an information coding program according to the 

present invention is an information coding program which causes a computer 
to execute a coding process of coding information bits which are inputted as a 
block of a two-dimensional image made up from m (where m is a natural 
number) x n (where n is a natural number) pixels, the coding process 
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comprising the steps of: arranging pixels which represent the information bits 
in a code area, which is an area of (m - o) x (n - p) pixels within a code block 
of m x n pixels (where o and p are natural numbers which satisfy 0<o<m and 
0<p<n); and arranging pixels which represent predetermined information bits 
5 in a guide area, which is an area of the other pixels within the code block of m 
x n pixels. 

[0026] In the coding process, the size and the position of a pixel 
which is arranged in the area of (m - o) x (n - p) pixels may be determined 
based upon the size of the area of (m - o) x (n - p) pixels. 

10 [0027] An information decoding program according to the present 

invention causes a computer to execute: a process of receiving input of a 
photographed image which has been obtained by photographing a two- 
dimensional image which consists of an area of m x n pixels, in which a single 
code block comprises a code area in which (m - o) x (n - p) pixels which 

15 represent information bits (where m and n are natural numbers, and o and p 
are natural numbers which satisfy 0<o<m and 0<p<n) are arranged, and a 
guide area in which no pixels which represent the information bits are 
arranged, and of estimating a pattern of the code block based upon the result 
of relative comparison between the photographed image and images in an 

20 ideal state; and a process of decoding the information bits of the 

photographed image which is inputted based upon the result of the estimation 
of the pattern. 

[0028] In the above described information coding program, the 
computer may be further caused to execute: a process of detecting an 
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amount of positional deviation between pixels of the two-dimensional image 
and pixels of the photographed image; a process of calculating ideal 
photographed images of code blocks corresponding to code patterns based 
upon the amount of positional deviation which has been detected; a process 
5 of comparing together the photographed image which is inputted and the ideal 
photographed images which have been calculated, and calculating relative 
values; and a process of estimating the pattern of the code block from the 
relative values which have been calculated. 

[0029] In the above described information coding program, the 

10 computer may further be caused to execute: a process of detecting an 

amount of positional deviation between pixels of the two-dimensional image 
and pixels of the photographed image; a process of calculating ideal 
photographed images of code blocks corresponding to code patterns based 
upon the amount of positional deviation which has been detected; a process 

15 of calculating ideal reconstructed images of code blocks based upon the ideal 
photographed images which have been calculated, and the amount of 
positional deviation which has been detected; a process of calculating a 
reconstructed image of the two-dimensional image from the photographed 
image based upon the amount of positional deviation which has been 

20 detected; a process of comparing together the reconstructed image which has 
been calculated from the photographed image and the reconstructed images 
which have been calculated from the code blocks, and calculating relative 
values; and a process of estimating the pattern of the code block from the 
relative values which have been calculated. 
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[0030] As has been explained above, when coding the information 
bits which are inputted as the two-dimensional image block made up from m 
(where m is a natural number) x n (where n is a natural number) pixels, the 
present invention arranges the pixels which represent the information bits in 
5 the code area, which is the area of (m - o) x (n - p) pixels within the code 

block of m x n pixels (where o and p are natural numbers which satisfy 0<o<m 
and 0<p<n), and arranges no pixels which represent the information bits in the 
guide area, which is the area of the other pixels within the code block of m x n 
pixels. Accordingly, in whatever manner the code blocks may be arranged in 
10 the two-dimensional image, the code areas are not arranged so as to be 
adjacent to one another, so that it is possible reliably to separate the code 
blocks. 

[0031] Furthermore, when coding the information bits which are 
inputted as the two-dimensional image block made up from m (where m is a 

15 natural number) x n (where n is a natural number) pixels, the present 

invention arranges the pixels which represent the information bits in the code 
area, which is the area of (m - o) x (n - p) pixels within the code block of m x n 
pixels (where o and p are natural numbers which satisfy 0<o<m and 0<p<n), 
and arranges the pixels which represent predetermined information bits in the 

20 guide area, which is the area of the other pixels within the code block of m x n 
pixels. Accordingly, in whatever manner the code blocks may be arranged in 
the two-dimensional image, the code areas are not arranged so as to be 
adjacent to one another, so that it is possible reliably to separate the code 
blocks. In addition, since the information bits which are arranged in the guide 
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are already known, it is possible to perform the decoding reliably by applying 
compensation corresponding to this. 

[0032] Furthermore, the present invention determines the size and 
the position of the pixel which is arranged in the area of (m - o) x (n - p) pixels 

5 based upon the size of the area of (m - o) x (n - p) pixels. Accordingly, in 
whatever manner the code blocks may be arranged in the two-dimensional 
image, the code areas are not arranged so as to be adjacent to one another, 
so that it is possible reliably to separate the code blocks; and also it is 
possible to design the coding with a high degree of freedom according to the 

10 needs of the user and the characteristics of the recording medium. 

[0033] Furthermore, the present invention receives input of the 
photographed image of the two-dimensional image which consists of the area 
of m x n pixels, in which a single code block comprises a code area in which 
(m - o) x (n - p) pixels which represent information bits (where m and n are 

15 natural numbers, and o and p are natural numbers which satisfy 0<o<m and 
0<p<n) are arranged, and a guide area in which no pixels which represent the 
information bits are arranged, estimates the pattern of the code block based 
upon the result of the relative comparison between the photographed image 
and the image in the ideal state, and decodes the information bits based 

20 upon the result of the estimation of the pattern. Accordingly, it is possible to 
estimate the recorded code pattern, and it is possible to decode the 
information which has been coded at high density with good efficiency. 

[0034] Furthermore, the present invention calculates the amount of 
positional deviation between the pixels of the two-dimensional image and the 
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pixels of the photographed image is detected, calculates the ideal 
photographed image of a code block corresponding to a code pattern based 
upon the amount of positional deviation which has been detected, compares 
together the photographed image which is inputted and the ideal 
5 photographed image which has been calculated, calculates the relative value, 
and estimates the pattern of the code block from the relative value which has 
been calculated. Accordingly, it is possible to estimate the recorded code 
pattern, and it is possible to decode the information which has been coded at 
high density with good efficiency. 

10 [0035] Furthermore, the present invention detects the amount of 

positional deviation between the pixels of the two-dimensional image and the 
pixels of the photographed image, calculates the ideal photographed image of 
a code block corresponding to a code pattern based upon the amount of 
positional deviation which has been detected, calculates the ideal 

15 reconstructed image of the code block based upon the ideal photographed 
image which has been calculated, and the amount of positional deviation 
which has been detected, calculates the reconstructed image of the two- 
dimensional image from the photographed image based upon the amount of 
positional deviation which has been detected, compares together the 

20 reconstructed image which has been calculated from the photographed image 
and the reconstructed image which has been calculated from the code block, 
calculates the relative value; and estimates the pattern of the code block from 
the relative value which has been calculated. Accordingly, it is possible to 
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estimate the recorded code pattern, and it is possible to decode the 
information which has been coded at high density with better efficiency. 

Brief Description of Drawings 
5 [0036] FIG. 1 is a figure for explanation of the flow of coding. 

[0037] FIGS. 2A and 2B are figures for explanation of a method of 
capturing a recorded image. 

[0038] FIGS. 3A and 3B are figures for explanation of a coding 
procedure. 

10 [0039] FIG. 4 is a figure for explanation of the structure of a code 

block. 

[0040] FIGS. 5A through 5E are figures for explanation of a method 
of separating code blocks. 

[0041] FIGS. 6A through 6D are figures for explanation of the size 
15 and the position of a bright spot. 

[0042] FIGS. 7A and 7B are figures for explanation of the flow of 
decoding. 

[0043] FIGS. 8A and 8B are figures for explanation of decoding 

steps. 

20 [0044] FIGS. 9A through 9P are figures for explanation of a code 

block. 

[0045] FIGS. 10A through 10C are figures for explanation of 
photography with an imaging device. 

15 
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[0046] FIGS. 1 1 A and 1 1 B are figures for explanation of the flow of 
calculation for a reconstructed image. 

[0047] FIG. 12 is a figure for explanation of the calculation of an ideal 
photographed image. 
5 [0048] FIG. 13 is a figure for explanation of the calculation of a 

reconstructed image. 

Best Mode for Carrying Out the Invention 
[0049] In the following, preferred embodiments of the present 
10 invention will be described with reference to the drawings; but the present 
invention is not to be considered as being limited to the embodiments below. 

[0050] First, the fundamental idea of the present invention will be 
explained. 

[0051] For example, now, it will be supposed that the value of a pixel 
15 in a two-dimensional image is represented in 256 steps, from 0 to 255. 

Furthermore, it will be supposed that the pixel value 0 denotes black and that 
the pixel value 255 denotes white. 

[0052] This is a definition formulated for the convenience of 
explanation; no special meaning is to be attributed to the numbers, or to white 
20 or black. 

[0053] When converting information into a two-dimensional image, 
the digital bit string for the information is not converted into the image without 
modification, but rather is divided up into bit strings of an appropriate length, 
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and each of these bit strings is converted into a code block, and these code 
blocks are arranged so as to form a two-dimensional image. 

[0054] At this time, when the code blocks are arranged close 
together, it may happen that some pixel of a code block may exert some 

5 influence upon an adjacent code block, and in this case it becomes 
impossible to separate the code blocks with good efficiency. 

[0055] To address this problem, pixels which have determinate pixel 
values are disposed between mutually adjacent code blocks. 

[0056] Now, as one example, a code block will be considered which 

10 is made up from 3x3 pixels, i.e., from 9 pixels. In this code block, 2x2 
pixels, i.e., 4 pixels, are used as a code area which records the actual 
information, and the remaining 5 pixels are used as a guide area. In the code 
area, information is represented by disposing appropriate pixel values, while, 
in the guide area, the pixel value is set to a determinate value, for example 0. 

15 It should be understood that, to speak as a generalization, if the code block is 
formed to consist of a pixel area which is m (where m is a natural number) x n 
(where n is a natural number) of pixels, then the code area is taken as being 
the pixel area (m - o) x (n - p) (where o and p are natural numbers which 
satisfy 0<o<m and 0<p<n), and the remaining area is taken as being the 

20 guide area. 

[0057] By doing so, 1 pixel guide area is certainly present between 
one code area and another, whatever may be the arrangement of the 3 x 3 
pixel code blocks, and accordingly it becomes possible to separate the code 
blocks from one another. 
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[0058] Furthermore, if m=3, n=3, o=1 , and p=1 , then, the code areas 
can represent 4 bits of information at a maximum, accordingly the coding rate 
is 4/9 at a maximum, so that it becomes possible to represent a larger amount 
of information with the aforesaid information coding method. 
5 [0059] Yet further, the arrangement of the pixel values of the code 

area can be as desired, so that it can be designed according to the system 
which performs recording and reproduction. 

[0060] Even further, the size of the code block can be as desired, so 
that it can be designed according to the system which performs recording and 
10 reproduction. 

[0061] Next, the code pattern is estimated by comparing the 
photographed image which has been actually obtained with the ideal 
photographed images of the code blocks with respect to code patterns, and 
the coded two-dimensional image is decoded. 
15 [0062] A first decoding method is as follows. 

[0063] First, a two-dimensional image is photographed by the 
imaging device, and is captured as the photographed image. 

[0064] Next, the amount of positional deviation between the two- 
dimensional image and the imaging device is detected, and ideal 
20 photographed images are calculated from the code patterns which are the 
subjects of decoding. 

[0065] The actual photographed image and the ideal photographed 
images are then compared together, and the closest pattern is estimated to 
be the code pattern. 
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[0066] A second decoding method is as follows. 

[0067] The photographed image is captured in the same manner as 
in the first method. 

[0068] Next, the amount of positional deviation between the two- 
5 dimensional image and the imaging device is detected. 

[0069] Next, ideal photographed images are calculated based upon 
the amount of positional deviation between the two-dimensional image and 
the imaging device and the code patterns which are the subjects of decoding, 
and ideal reconstructed images are calculated based upon these ideal 
10 photographed images and the amount of positional deviation. 

[0070] Next, a reconstructed image of the two-dimensional image, in 
other words an actual reconstructed image, is calculated based upon the 
amount of positional deviation which has been detected and the 
photographed image. 
15 [0071] This actual reconstructed image and the ideal reconstructed 

images are then compared together, and the closest pattern is estimated to 
be the code pattern. 

[0072] In this connection, with regard to a method for detecting the 
positional deviation, the applicant of this invention has previously filed 
20 Japanese Patent Application No. 2002-247682 (Japanese Unexamined 

Patent Application, First Publication No. 2003-150898), and, for example, the 
method described in the specification of that application may be used. That 
is, a predetermined pattern is recorded in advance within the two-dimensional 
image, and, when performing the decoding, the rough position of this pattern 
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is detected, and the detailed position of the pattern is detected based upon 
the rough position which has been detected and a calculated center of gravity 
of the distribution of the similarity between an area within the photographed 
image and the pattern. Then, the amount of positional deviation between the 
5 two-dimensional image and the imaging device is detected based upon the 
position of the pattern which is recorded in advance, and the detailed position 
of the pattern which has been detected during decoding. 

[0073] In this manner, when code blocks are utilized which are made 
up of the aforementioned code areas and guide areas, the guide areas are 

10 definitely present around the code areas. Accordingly, the pixels of the 
imaging device which photographs the code areas are, at maximum, 3x3 
pixels, and, within these pixel areas, nothing other than the pixels of the code 
areas exerts any influence upon the pixel values. 

[0074] Accordingly, it is possible to calculate ideal photographed 

15 images and ideal reconstructed images so as to correspond to an actual 

photographed image and an actual reconstructed image based upon the code 
patterns which are the subjects and the amount of positional deviation 
between the two-dimensional image and the imaging device, so that it is 
possible to estimate the code pattern by comparing together these ideal 

20 photographed images and ideal reconstructed images with the actual 
photographed image and the actual reconstructed image. 

[0075] It should be understood that the two-dimensional image which 
is photographed by the imaging device is normally one which is taken out 
from some kind of medium, or is written upon some kind of medium, and it 
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may happen that a distortion or the like upon the imaging device takes place 
as it is photographed. In this case, it is effective to employ the second 
method, and to estimate the code pattern by calculating the reconstructed 
image in consideration of the positional deviation and the distortion. 

[0076] Furthermore, if there is no distortion or the like, or if it can be 
ignored, the first method which can be performed with less calculation will be 
effective. 

[0077] In the following, embodiments of the information coding 
apparatus, the information decoding apparatus, and methods for the same 
according to the present invention will be explained with reference to the 
drawings. 

- EMBODIMENT 1 : CODING APPARATUS AND METHOD - 

[0078] According to the coding apparatus and the method for the 
15 same according to this embodiment, the input information, in other words the 
bits of information, is coded in a two-dimensional image in which one code 
block is made up of an area of m x n pixels, having a code area in which (m - 
o) x (n - p) pixels which represent bits of information (where m and n are 
natural numbers, and o and p are natural numbers which satisfy 0<o<m and 
20 0<p<n) are disposed, and a guide area in which no pixels which represent bits 
of information are disposed. 

[0079] In the following, the coding apparatus and method of this 
embodiment will be explained with reference to the drawings, for the case in 
which the values of m, n, o, and p described above are m=3, n=3, o=1 , and 
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p=1 . It should be understood that these set values are only examples, and 
the same method could be applied in other cases as well. 

[0080] FIG. 1 shows the structure of a coding apparatus 1 -2 of this 
embodiment. 

5 [0081] The coding apparatus 1-2 of this embodiment comprises a bit 

string conversion section 1-3, a bit string division section 1-4, a code block 
conversion section 1-5, and an image generation section 1-6. 

[0082] The bit string conversion section 1-3 receives input of 
information 1-1 , and performs processing to convert it into a bit string. 

10 [0083] The bit string division section 1-4 receives input of the bits of 

information which have been converted into the bit string, and divides the 
information bits into predetermined units. 

[0084] The code block conversion section 1-5 receives input of the 
bits of information which have been divided into a plurality of units, and codes 

15 these bits of information as two-dimensional image blocks which consist of m 
(where m is a natural number) x n (where n is a natural number) pixels. 

[0085] At this time, the code block conversion section 1-5 arranges 
those pixels which represent bits of information in an area of (m - o) x (n - p) 
pixels (where o and p are natural numbers which satisfy 0<o<m and 0<p<n) 

20 within the code block of m x n pixels, and does not arrange any pixels which 
represent bits of information in the other pixel areas within the code block of m 
x n pixels. Furthermore, it would also be acceptable to arrange pixels which 
represent previously determined information bits in an area of the other pixels 
within the code block of m x n pixels. 
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[0086] Moreover, the sizes and the positions of the pixels which are 
arranged in this area of (m - o) x (n - p) pixels are determined based upon the 
size of the area of (m - o) x (n - p) pixels. 

[0087] The image generation section 1-6 converts the code blocks 
5 which have been converted into two-dimensional images to be recorded, and 
outputs the images. 

[0088] In other words, the information 1-1 which has been inputted is 
first converted into a bit string by the bit string conversion section 1-3. This bit 
string which has been converted is divided by the bit string division section 1- 
10 4. These divided bit strings are converted into code blocks by the code block 
conversion section 1-5. These code blocks which have been converted are 
converted into images to be recorded by the image generation section 1-6, 
and are outputted as recorded images 1-7 which have been coded. 

[0089] A concrete coding method will now be explained in the 
15 following. 

[0090] Now let it be supposed that the image to be recorded consists 
of bright points (so-called bright spots), and when it is photographed with the 
CCD, an image is captured such that the area where the bright spot is present 
becomes white, while the area where the bright spot is not present becomes 
20 black. Here, this is a matter which is defined for the purposes of the 

explanation; there is no special meaning to the allotment of white and black. 

[0091] This situation is shown in FIGS. 2A and 2B. The images 
which are to be recorded consist of the bright spots 2-1 and 2-3, and the 
respective pixels of the CCD are represented by lattices as shown by 2-2 and 
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2-4. In addition, the images which are captured by the CCD are as in 2-5 and 
2-6. 

[0092] At this time, as shown in FIG. 2A, the bright spot 2-1 and the 
pixel 2-2 of the CCD are exactly in register, and a reproduced image 2-5 
5 results in which the areas where the bright spots are present are represented 
as white (2-7), while the areas where no bright spots are present are 
represented as black (2-8). On the other hand, in the case of FIG. 2B, the 
bright spots 2-3 and the pixels 2-4 of the CCD are located as deviated from 
one another, so that, in this situation, when photography is performed, the 
10 reproduced image 2-6 results which is made up by the pixels 2-9, 2-10, and 2- 
1 1 , and it is not possible to reconstruct the original situation. 

[0093] To this purpose, a recorded image is generated from the 
information to be recorded in accordance with the coding method of this 
embodiment. 

15 [0094] FIGS. 3A and 3B are figures for explanation of this coding 

procedure. As shown in FIGS. 3A and 3B, the information coding apparatus 
represents the information which is to be coded (3-1) as digital bits (3-3), 
divides these digital bits up into bit strings which correspond to code blocks 
(3-5), and performs coding for each of these bit strings (3-7). 

20 [0095] Specifically, information 3-2 is represented as digital bits 3-4, 

and this is divided at a predetermined length, so as to generate bit strings 3-6. 

[0096] The length of each of these bit strings is determined by how 
many bit strings are to be represented with a single code block. Here, the 
example is shown of coding 4 bits into a single code block. 
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[0097] These bit strings 3-6 are then coded into the code blocks 3-9. 
Here, it is supposed that the code block 3-9 comprises a bright spot 3-8, and 
that no bright spot is arranged in the area (3-10) in which nothing is present. 
[0098] At this time, it would also be acceptable to freely determine 
5 the number of bright spots per one bit string, arrangement methods such as 
the pattern of bright spots, and the length of the bit strings which is 
represented by one code block. However, the code block follows the 
structure as shown in FIG. 4. In other words, it is supposed that the sizes and 
positions of the pixels which are arranged in the area of (m - o) x (n - p) pixels 
10 is determined based upon the size of the area of (m - o) x (n - p) pixels. 

[0099] The code block consists of a code area 4-1 and a guide area 
4-3. In other words, a single code block consists of an m x n pixel area which 
includes a code area in which (m - o) x (n - p) pixels (where m and n are 
natural numbers, and o and p are natural numbers which satisfy 0<o<m and 
15 0<p<n) which represent information bits are arranged, and a guide area in 
which no pixels which represent information bits are arranged. Thus, in this 
case, the information to be recorded is represented by the code area. 

[00100] Now, suppose that a bright spot is arranged like, for example, 
4-2. In other words, the bright spot can be freely arranged within the code 
20 area 4-1 , while the guide area is constituted by a determinate pattern. This 
figure shows a pattern in which no bright spot is arranged in the guide area. 

[00101] By making the code block in this manner, no code areas are 
ever arranged so as to be adjacent to one another, no matter in what manner 
the code blocks may be arranged upon the two-dimensional image. 
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[00102] This is the reason that it is possible to separate the code 
blocks. 

[00103] Finally, the images which have been converted into code 
blocks are arranged, and the recorded image is generated. 

[00104] FIGS. 5A through 5E show the separation of the code blocks 
upon the recoded image. 

[00105] As shown in FIG. 5E, the recorded image 5-1 consists of 9 
code blocks 5-2, and each of these code blocks includes bright spots 5-3. 
Furthermore, the colored area 5-4 represents the guide area. 

[00106] Here, the reproduction by the CCD for the area 5-5 at the 
central area will be considered. An area 5-7 shows an example of the 
extracted area 5-5. 5-6 denotes the pixels of the CCD. According to the 
degree of deviation of the CCD pixels 5-6 with respect to the area 5-7, FIGS. 
5A through 5D are considered. 

[00107] In this case, the area 5-8 of the CCD pixels which includes 
bright spots does not definitely include any bright spots other than those at the 
code area, i.e., at its central area. Accordingly, it is possible to observe the 
pattern of the bright spot only in the local area which is limited to the area 5-8, 
so that it becomes possible to separate and deal with each code block. 

[00108] In FIGS. 6A through 6D, the size and the position of the bright 
spot which is disposed within the code block are explained. In FIG. 6A, four 
bright spots are arranged within the code block, and the bright spots are 
formed as circles, and the size 6-2 of the bright spots is the same as the size 
of the pixels. Furthermore, the pitch 6-1 of the bright spots is the same as the 
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pitch of the pixels. According to the reading out method, bright spots may be 
arranged as shown in FIGS. 6B, 6C, or 6D; the pitch of the bright spots may 
be any of 6-3, 6-5, and 6-7, and the size of the bright spots may be any of 6-4, 
6-6, and 6-8. 

5 [00109] In FIG. 6B, the size 6-4 of the bright spots is the same, but the 

pitch 6-3 of the bright spots is smaller than the pixel pitch. 

[00110] In FIG. 6C, the size 6-6 of the bright spots is made smaller, 
but the pitch 6-5 of the bright spots is made to be larger than the pixel pitch. 

[00111] In FIG. 6D, the size 6-8 of the bright spots and the pitch 6-7 of 
10 the bright spots are both made to be smaller. 

[00112] It should be understood that it would be acceptable to arrange 
the bright spots by some other method. In other words, since it becomes 
possible to separate the code blocks during reproduction provided that the 
bright spots are kept within the code areas, accordingly it will be acceptable to 
15 arrange the bright spots freely within the code areas. 

[001 13] Furthermore, apart from the shapes or the sizes of the bright 
spots, it would also be acceptable to vary the brightness distribution of the 
arranged bright spots, provided that they are kept within the code areas. 

20 - EMBODIMENT 2: DECODING APPARATUS AND METHOD - 

[00114] According to the decoding apparatus and method of this 
embodiment, in response to input of a photographed image, which is a 
photographed two-dimensional image made up of an area of m x n pixels in 
which one code block has a code area in which (m - o) x (n - p) pixels which 
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represent bits of information (where m and n are natural numbers, and o and 
p are natural numbers which satisfy 0<o<m and 0<p<n) are arranged, and a 
guide area in which no pixels which represent information bits are arranged, 
the information bits of the photographed image which are inputted are 
5 decoded. 

[00115] Jn the following, the decoding apparatus and method for the 
same according to this embodiment will be explained with/eference to the 
drawings, for the case in which the values of m, n, o, and p described above 
are m=3, n=3, o=1 , and p=1 . It should be understood that the same method 

10 could be applied in other cases as well. 

[00116] Now let it be supposed that the recorded image includes 
bright points (so-called bright spots), and when it is photographed with the 
CCD, an image is captured such that the portion where the bright spot is 
present becomes white, while the portion where the bright spot is not present 

15 becomes black. Here, this is a matter which is defined for the purposes of the 
explanation; there is no special meaning to the allotment of white and black. 

[00117] FIGS. 7A and 7B show the structures of two types of decoding 
apparatus 7-2a and 7-2b, as examples of the structure of the decoding 
apparatus according to this embodiment. As shown in FIG. 7A, the decoding 

20 apparatus 7-2a of this embodiment comprises a positional deviation amount 
detection section 7-3, an ideal photographed image calculation section 7-4, an 
image comparison section 7-5, a code pattern estimation section 7-6, and a 
bit string reconstruction section 7-7. 
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[00118] The positional deviation amount detection section 7-3 detects 
the amount of positional deviation between the two-dimensional image which 
has been coded and the photographed image 7-1. 

[00119] The ideal photographed image calculation section 7-4 
5 calculates ideal photographed images, based upon the amount of positional 
deviation which has been detected. Here, by the ideal photographed images, 
are meant photographed images of the code blocks for all the code patterns 
which are used by the code block conversion section 1-5 in the coding 
apparatus. 

10 [00120] The image comparison section 7-5 compares together the 

ideal photographed images which have been calculated by the ideal 
photographed image calculation section 7-4 and the actual photographed 
image 7-1 . Here, in concrete terms, this comparison by the image 
comparison section 7-5 means, for example, the calculation of a relative value 

15 (for example, similarity) between the photographed image which has been 
inputted and the ideal photographed images which have been calculated, as 
will be described hereinafter. 

[00121] The code pattern estimation section 7-6 estimates the pattern 
of the code block, based upon the relative value which is calculated by the 

20 image comparison section 7-5. For example, the code pattern inference 
section 7-6 estimates that the pattern which has the highest similarity, as 
calculated by the image comparison section 7-5, is the pattern of the code 
block. 
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[00122] The bit string reconstruction section 7-7 decodes the 
information bits, based upon the result of pattern estimation, and outputs it. 

[00123] In other words, when a photographed image 7-1 of a two- 
dimensional image which has been coded is inputted to the decoding 

5 apparatus 7-2a, first, the amount of positional deviation between the two- 
dimensional image and the photographed image is detected by the positional 
deviation amount detection section 7-3. Next: ideal photographed images are 
calculated by the ideal photographed image calculation section 7-4 based 
upon the amount of positional deviation which has been detected; these ideal 

10 photographed images which have been calculated and the actual 

photographed image 7-1 are compared together by the image comparison 
section 7-5; a code pattern is estimated by the code pattern estimation section 
7-6 based upon the result of this comparison; and bit strings are reconstructed 
by the bit string reconstruction section 7-7 based upon the result of this 

15 estimation, and are outputted as the decoded information 7-8. 

[00124] Furthermore, as another apparatus structure of the decoding 
apparatus according to this embodiment, the decoding apparatus 7-2b shown 
in FIG. 7B is configured by providing an ideal reconstructed image calculation 
section 7-9, a reconstructed image calculation section 7-10, and an image 

20 comparison section 7-1 1 between the above-described ideal photographed 
image calculation section 7-4 and the code pattern estimation section 7-6. 

[00125] In other words, in this case, the decoding apparatus 7-2b 
according to this embodiment is made up from the positional deviation amount 
detection section 7-3, the ideal photographed image calculation section 7-4, 
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the ideal reconstructed image calculation section 7-9, the reconstructed image 
calculation section 7-10, the image compensation section 7-1 1 , the code 
pattern estimation section 7-6, and the bit string reconstruction section 7-7. 

[00126] The positional deviation amount detection section 7-3 detects 

5 the amount of positional deviation between the two-dimensional image which 
has been coded and the photographed image. 

[00127] The ideal photographed image calculation section 7-4, as 
described previously, calculates ideal photographed images, based upon the 
amount of positional deviation which has been detected. Here, by the ideal 

10 photographed images, are meant photographed images of the code blocks for 
all the code patterns which are used by the code block conversion section 1-5 
in the coding apparatus. 

[00128] The ideal reconstructed image calculation section 7-9 
calculates ideal reconstructed images of the two-dimensional image from the 

15 ideal photographed images which have been calculated by the ideal 
photographed image calculation section 7-4, based upon the amount of 
positional deviation which has been detected by the positional deviation 
amount detection section 7-3, and transfers them to the image comparison 
section 7-1 1 . 

20 [00129] The reconstructed image calculation section 7-10 calculates 

the reconstructed image of the two-dimensional image from the photographed 
image, based upon the amount of positional deviation which has been 
detected by the positional deviation amount detection section 7-3, and 
transfers it to the image comparison section 7-11. 



Attorney Docket No.: 5259-000045 



[00130] The image comparison section 7-1 1 calculates a relative 
value (for example, similarity) between the ideal reconstructed images which 
have been calculated by the ideal reconstructed image calculation section 7- 
9, and the reconstructed image which has been calculated by the 
5 reconstructed image calculation section 7-10. 

[00131] The code pattern estimation section 7-6 estimates the pattern 
of the code block, based upon the relative value which has been calculated by 
the image comparison section 7-1 1 . For example, this code pattern 
estimation section 7-6 estimates that the pattern which has the highest 
10 similarity, as calculated by the image comparison section 7-5, is the pattern of 
the code block. 

[00132] The bit string reconstruction section 7-7 decodes the 
information bits, based upon the result of pattern estimation, and outputs it. 

[00133] The two procedures for the decoding methods of FIGS. 8A 
15 and 8B will now be explained. 

[00134] First, the first method shown in FIG. 8A will be explained. 

[00135] In the photographic state in which the two-dimensional image 
and the imaging device are in an appropriate positional relationship (the step 
8-1), a two-dimensional image is photographed by the imaging device, and 
20 this is taken as the photographed image (in the step 8-2). 

[00136] Next, the amount of positional deviation between the two- 
dimensional image and the imaging device is detected (in the step 8-3). That 
is, as described above, a predetermined pattern is recorded in advance within 
the two-dimensional image, and, when performing the decoding, the rough 
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position of this pattern within the photographed image is detected, and the 
detailed position of the pattern is detected based upon the rough position 
which has been detected and a calculated center of gravity of the distribution 
of the similarity between an area within the photographed image and the 

5 pattern. Then, the positional deviation amount between the two -dimensional 
image and the imaging device is detected based upon the position of the 
pattern which is recorded in advance, and the detailed position of the pattern 
which has been detected during decoding. 

[00137] Ideal photographed images are calculated for the respective 

10 code patterns, based upon the amount of positional deviation which has been 
detected, and all the code patterns which are the subjects of decoding (in the 
step 8-4). 

[00138] The actual photographed image and the ideal photographed 
images are then compared together (in the step 8-5). 
15 [00139] The code pattern for the ideal photographed image which is 

found to be the closest by this comparison is estimated to be the code pattern 
which is recorded (in the step 8-6). 

[00140] Next, the second method shown in FIG. 8B will be explained. 

[00141] In the same way as in the first method, a two-dimensional 
20 image is photographed, and this is taken as the photographed image (in the 
steps 8-7 and 8-8). 

[00142] Next, by a method which is the same as in the step 8-3, the 
amount of positional deviation between the two-dimensional image and the 
imaging device is detected (in the step 8-9). 
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[00143] Next, the ideal photographed images for the respective code 
patterns are calculated based upon the amount of positional deviation 
between the two-dimensional image and the imaging device, and upon the 
code patterns which are the subjects of decoding (in the step 8-10). 
5 [00144] Next, the ideal reconstructed images are calculated based 

upon this ideal photographed images and the amount of positional deviation 
(in the step 8-11). 

[00145] Next, a reconstructed image of the two-dimensional image is 
calculated based upon the amount of positional deviation which has been 
10 detected and the photographed image, (in the step 8-12). 

[00146] Then, the actual reconstructed image and the ideal 
reconstructed images are compared together (in the step 8-13). 

[00147] The pattern which is found to be the closest by this 
comparison is estimated to be the code pattern (in the step 8-14). 
15 [00148] Furthermore, the two-dimensional image which is 

photographed by the imaging device is normally one which is taken out from 
some kind of medium, or is written upon some kind of medium; and it 
sometimes happens that a distortion or the like upon the imaging device takes 
place as it is photographed. In this case, the second method is applied, in 
20 which the reconstructed image is calculated in consideration of positional 
deviation and distortion, and the code pattern is estimated. 

[00149] It should be understood that the photographed image 7-1 is 
obtained via the steps 8-1 , 8-7, 8-2, and 8-8, the positional deviation amount 
detection section 7-3 performs the steps 8-3 and 8-9, the ideal photographed 
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image calculation section 7-4 performs the steps 8-4 and 8-10, the ideal 
reconstructed image calculation section 7-9 performs the step 8-1 1 , the 
reconstructed image calculation section 7-10 performs the step 8-12, the 
image comparison sections 7-5 and 7-1 1 respectively perform the steps 8-5 
5 and 8-13, and the code pattern estimation section 7-6 performs the steps 8-6 
and 8-14. The bit string reconstruction section 7-7 reconstructs the bit string 
of the code pattern which has been estimated from the bit string which was 
associated with the code pattern during coding, and finally outputs it as the 
decoded information 7-8. 
10 [00150] In the following, the first and second methods will be 

explained in concrete terms. 

[00151] First, the first method will be explained. 

[00152] Initially, the code blocks are defined as in FIGS. 9A through 
9P. These code blocks are made up from code areas 9-1 and guide areas 9- 
15 2, and bright spots 9-3 are present within the code areas 9-1 . 

[00153] Here, there are sixteen code patterns in which the number of 
the bright spots within the code area is 0, 1 , 2, 3, or 4. In practice, the 
information bits are allocated to these code patterns, and they are used during 
reconstruction of the bit strings by the bit string reconstruction section 7-7. 
20 Accordingly, in this case, 16 patterns, in other words 4 bits, can be 
represented with 3x3 pixels, i.e., 9 pixels. 

[00154] The photography by the imaging device is explained in FIGS. 
10A through 10C. The recorded image 10-1 is made up from the 9 code 
blocks 10-2, and bright spots 10-3 are present in each of the code blocks. 
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Furthermore, the area 10-4 which surrounds the code blocks represents the 
guide area. 

[00155] At this time, photography by the imaging device of the area 
1 0-5 in the central area is considered. 
5 [00156] For example, FIG. 10B shows the photographic state 10-6 for 

the area 10-5. The area 10-7 corresponds to the area 10-5, 10-8 represents 
the code area of the code block, 10-9 represents the guide area which 
surrounds the code area, 10-10 represents the bright spot in the code area, 
and 10-1 1 represents the pixels of the imaging device; and the recorded 

10 image and the imaging device are arranged so as to be mutually deviated by 
the deviation 10-13. 

[00157] In this case, 10-12 represents the area of pixels of the 
imaging device which includes the bright spot, and, since the guide area is 
present in the periphery of the code area, there is certainly no bright spot 

15 included in the area 10-12 except for the bright spots in its central area. 
Accordingly, it is possible to deal only with the area 10-12 during the 
processes after photography. 

[00158] Here, it is supposed that the recorded image and the imaging 
device are mutually deviated by 0.5 pixel in both the horizontal direction and 

20 the vertical direction. In this case, the photographed image 10-14 represents 
the image which has been photographed in the photographic state 10-6. 
Here, the pixel values are shown by color, as with 10-15. In other words, the 
area where the bright spot is present is white, while the areas where it is not 
present are shown by black. 
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[00159] In other words, if the code block consists of m x n pixels, and 
the code area is (m - o) x (n - p) pixels (where m and n are natural numbers, 
and o and p are natural numbers which satisfy 0<o<m and 0<p<n), then the 
area 10-12 consists of (m - o + 1) x (n - p + 1) pixels. That is, the 

5 photographed image 10-14 is an image of (m - o + 1) x (n - p + 1) pixels. 
Here, when m=3, n=3, o=1, and p=1, the photographed image 10-14 is an 
image of 3 x 3 pixels. 

[00160] FIGS. 1 1 A and 1 1 B show the flow of calculation of ideal 
photographed images from the code patterns. Ideal photographed images 

10 11-5 for the respective code patterns are calculated based upon all the code 
patterns 11-4 which are to be the subjects, and the amount of positional 
deviation 11-2. Then, the ideal photographed images 11-5 which have been 
calculated and the actual photographed image 11-1 are compared together, 
and the code pattern is thereby estimated. Specifically, for example, image 

15 matching is performed, similarity is calculated, and the comparison is 
performed with the result thereof. 

[00161] Here, as has been explained in the above description, the 
actual photographed image 11-1 and the ideal photographed images 11-5 are 
generally images of (m - o + 1) x (n - p + 1) pixels, and, if m=3, n=3, o=1 , and 

20 p=1 , they are images of 3 x 3 pixels. Specifically, the ideal photographed 
images 11-5 are calculated by the following method. 

[00162] In FIG. 12, the flow of the calculation of the ideal 
photographed images is explained. 
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[00163] It is possible to calculate the ideal photographed images from 
the amount of positional deviation between the recorded image and the 
imaging device, and the code patterns. 12-1 shows the positional relationship 
between the pixels of a code pattern and of an ideal photographed image. 

5 The code pattern 12-2 of 4 x 4 pixels which includes the guide areas of the 
neighboring code patterns, and the pixels 12-3 of the ideal photographed 
image of 3 x 3 pixels, are in a positional relationship which is deviated by the 
amount of positional deviation 12-4. 

[00164] At this time, a magnified view of the vicinity of a part of the 

10 pixels is shown in FIG. 12-5. 

[00165] 12-6 represents the code pattern, and it is considered with the 
pixels numbered from 10 through 13. 12-7 represents a pixel of the ideal 
photographed image, and a pixel deviation of 12-8 in the horizontal direction 
and a pixel deviation 12-9 in the vertical direction are present. 

15 [00166] At this time, the respective values with the amount of 

positional deviation normalized at the pixel size are taken as s and t, and the 
pixel values of each of the pixels 10 through 13 of the photographed image 
are respectively taken as v10, v1 1 , v12, and v13. In this case, the pixel 12-7 
is obtained by the following Equation (1): 

20 (1 -s)*(1 -t)*v10 + s*(1 -t)*v11 +(1 - s)*t*v12 + s*t*v13 (1) 
[00167] Furthermore, the comparison of the ideal photographed 
images 11-5 and the actual photographed image 11-1 is performed, for 
example, by image matching, and calculation of similarity is performed. 
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[00168] Three methods will be explained for the method of calculation 
of the similarity. One of these is a method of calculating the similarity 
between the two images based upon the difference between them. If the pixel 
value for the pixel (x, y) of the actual photographed image 11-1 is taken as f(x, 
5 y), and the pixel value for the pixel (x, y) of the ideal photographed image 11-5 
of the code pattern Pt is taken as g R (x, y), then the similarity can be 
calculated by Equation (2): 

ZZ|f(x,y)-g Pt (x,y)| (2) 

x y 

[00169] The code pattern Pt for which this value is minimum is taken 
10 as being the estimated pattern. In this case, it is effective to perform some 
type of normalization for the actual pixel values, or for the ideal pixel values, 
since unevenness in brightness or differences in brightness level may occur in 
the actual photographed image 

[00170] The second method is a method of calculating the similarity 
15 between the two images by normalization correlation. In the same way as 
with the method of calculating the similarity based upon the difference, if the 
pixel value for the pixel (x, y) of the actual photographed image 11-1 is taken 
as f(x, y), and the pixel value for the pixel (x, y) of the ideal photographed 
image 1 1-5 of the code pattern Pt is taken as gp t (x, y), then the similarity can 
20 be calculated by Equation (3): 

ZXf(x,y)g Pt (x,y) 
JZZgp, (x,y) 

V x y 
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[00171] The code pattern Pt for which this value is maximum is taken 
as being the estimated pattern. It should be noted that it is not possible to 
utilize Equation (3) if the denominator of Equation (3) becomes zero. In this 
case, the method using Equation (2) should be utilized. 

5 [00172] The third method is a method of calculating the similarity 

between the two images by correlation after having performed normalization 
upon the average value and the standard deviation of the pixel values. As in 
the above-described two methods, if the pixel value for the pixel (x, y) of the 
actual photographed image 11-1 is taken as f(x, y), and the pixel value for the 

10 pixel (x, y) of the ideal photographed image 1 1-5 of the code pattern Pt is 
taken as gpt(x, y), then the similarity can be calculated by Equation (4): 

r f(x >y )-m f gPt(*,y)-m gpt Y 



zz 

x y 



a f a 



(4) 



[00173] Here, m f and m g p t respectively represent the average values 
of f(x, y) and gp t (x, y), while at and q s r respectively represent the standard 

15 deviations of f(x, y) and gp t (x, y). The code pattern Pt for which the value of 
this Equation (4) is the minimum is taken as the estimated pattern. It should 
be noted that it is not possible to utilize this equation if a f or a gPt becomes 
zero. In this case, the method which utilizes Equation (2) or the method which 
utilizes Equation (3) should be employed (however, only in the case that the 

20 denominator of Equation (3) does not become zero). 

[00174] By utilizing Equation (4), it is possible to calculate the 
similarity to a higher accuracy, as compared to the cases of utilizing Equation 
(2) or Equation (3). 
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[00175] Here, in the three above-described methods of calculating the 
similarity, if the code block consists of 3 x 3 pixels, and the code area consists 
of 2 x 2 pixels, then the actual photographed image 11-1 and the ideal 
photographed images 11-5 are images of 3 x 3 pixels. Accordingly, the range 
5 of x and y for f(x, y) and g Pt (x, y) is the range of 3 x 3 pixels. 

[00176] Generally, if a code block consists of m x n pixels, and the 
code area consists of (m - o) x (n - p) pixels (where m and n are natural 
numbers, and o and p are natural numbers which satisfy 0<o<m and 0<p<n), 
then the actual photographed image and the ideal photographed images are 
10 images of (m - o + 1 ) x (n - p + 1 ) pixels. Accordingly, the range of x and y for 
f(x, y) and g Pt (x, y) is the range of (m - o + 1) x (n - p + 1) pixels. 

[00177] According to the above-described methods, even if the pitch 
or the position of the bright spots, or the size of the bright spots, or the 
brightness of the bright spots are different, it is possible to calculate their ideal 
15 behavior, so that the code pattern can be estimated. 

[00178] Next, the second method will be explained. 
[00179] As in the first method, initially, the code blocks are defined as 
in FIGS. 9A through 9P. These code blocks are made up from code areas 9- 
1 and guide areas 9-2, and bright spots 9-3 are present within the code areas 
20 9-1. 

[00180] Here, there are sixteen code patterns in which the number of 
the bright spots within the code area is 0, 1 , 2, 3, or 4. In practice, the 
information bits are allocated to these code patterns, and they are used during 
reconstruction of the bit strings by the bit string reconstruction section 7-7. 
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Accordingly, in this case, 16 patterns, in other words 4 bits, can be 
represented with 3x3 pixels, i.e., 9 pixels. 

[00181] The photography by the imaging device is explained in FIGS. 
10A through 10C. The recorded image 10-1 is made up from the 9 code 
5 blocks 10-2, and bright spots 10-3 are present in each of the code blocks. 
Furthermore, the area 10-4 which surrounds the code blocks represents the 
guide area. 

[00182] At this time, photography by the imaging device of the area 
10-5 in the central area is considered. 

10 [00183] For example, 10-6 shows the photographic state for the area 

10-5. The area 10-7 corresponds to the area 10-5, and 10-8 represents the 
code area of the code block, 10-9 represents the guide area which surrounds 
the code area, 10-10 represents the bright spot in the code area, and 10-1 1 
represents the pixels of the imaging device; and the recorded image and the 

15 imaging device are arranged so as to be mutually deviated by the deviation 
10-13. 

[00184] In this case, 10-12 represents the area of pixels of the 
imaging device which includes the bright spot, and, since the guide area is 
present in the periphery of the code area, there is certainly no bright spot 
20 included in the area 10-12 except for the bright spots in its central area. 
Accordingly, it is possible to deal only with the area 10-12 during the 
processes after photography. 

[00185] Here, it is supposed that the recorded image and the imaging 
device are mutually deviated by 0.5 pixel in both the horizontal direction and 
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the vertical direction. In this case, the photographed image 10-14 represents 
the image which has been photographed in the photographic state 10-6. 
Here, the pixel values are shown by color, as with 10-15. In other words, the 
area where the bright spot is present is shown by white, while the area where 
5 the bright spot is not present is shown by black. 

[00186] In other words, if the code block consists of m x n pixels, and 
the code area consists of (m - o) x (n - p) pixels (where m and n are natural 
numbers, and o and p are natural numbers which satisfy 0<o<m and 0<p<n), 
then the area 10-12 consists of (m - o + 1) x (n - p + 1) pixels. In other words, 

10 the photographed image 10-14 is an image of (m - o + 1) x (n - p + 1) pixels. 
Here, when m=3, n=3, o=1 , and p=1 , the photographed image 10-14 is an 
image of 3 x 3 pixels. 

[00187] In FIGS. 1 1 A and 1 1 B, the flow of calculation of the 
reconstructed image is shown. 

15 [00188] The reconstructed image of the actual photographed image 

can be calculated from the photographed image 11-1 and the amount of 
positional deviation 11-2 between the recorded image and the imaging device. 
The reconstructed image 1 1-3 is obtained as the result thereof. The details of 
the calculation of obtaining the reconstructed image 11-3 from the 

20 photographed image 11-1 and the amount of positional deviation 11-2 will be 
explained with reference to FIG. 13. 

[00189] As for the reconstructed images of the ideal photographed 
images, ideal photographed images 11-5 for the respective code patterns are 
calculated based upon all the code patterns 11-4 which are to be the subjects 
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and the amount of positional deviation 1 1 -2, and the ideal reconstructed 
images 1 1 -6 are obtained from these ideal photographed images 1 1 -5 and the 
amount of positional deviation 11-2. 

[00190] Here, as has been explained in the above description, the 

5 actual photographed image 11-1 and the ideal photographed images 11-5 are 
generally images of (m - o + 1) x (n - p + 1) pixels, and, if m=3, n=3, o=1 , and 
p=1 , then these photographed images are images of 3 x 3 pixels. 

[00191] Furthermore, the actual reconstructed image 11-3 and the 
ideal reconstructed images 11-6 are images of (m - o) x (n - p) pixels in the 

10 same manner as the code area, and, if m=3, n=3, o=1 , and p=1 , these 
reconstructed images are images of 2 x 2 pixels. 

[00192] Here, the details of the calculation to obtain the ideal 
photographed images may be performed by a method the same as in the 
case of the calculation of the ideal photographed images in the first method. 

15 [00193] The method of obtaining the ideal photographed images will 

now be explained with reference to FIG. 12. The ideal photographed images 
can be calculated from the amount of positional deviation between the 
recorded image and the imaging device, and the code patterns. 12-1 shows 
the positional relationship between a code pattern and the pixels of an ideal 

20 photographed image. The code pattern 12-2 of 4 x 4 pixels including the 

guide area of the neighbouring code patterns, and the 3 x 3 pixels 12-3 of the 
ideal photographed image are in the positional relationship of being deviated 
by the amount of positional deviation 12-4. 
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[00194] A magnified view of the vicinity of a part of the pixels at this 
time is shown in FIG. 12-5. 

[00195] 12-6 represents the code pattern, and it is considered with the 
pixels numbered from 10 through 13. 12-7 represents a pixel of the ideal 
5 photographed image, and a pixel deviation of 12-8 in the horizontal direction 
and a pixel deviation of 12-9 in the vertical direction are present. 

[00196] At this time, the respective values with the amount of 
positional deviation normalized at the pixel size are taken as s and t, and the 
pixel values of each of the pixels 10 through 13 of the photographed image 
10 are respectively taken as v1 0, v1 1 , v1 2, and v1 3. At this time, the pixel 1 2-7 
is obtained according to the previously described Equation (1). 

[00197] Furthermore, the details of the calculation to obtain the ideal 
reconstructed images 11-6 from the ideal photographed images 11-5 and the 
amount of positional deviation 11-2 will be explained with reference to FIG. 
15 13. 

[00198] FIG. 13 explains the details of the above-described method of 
calculating the reconstructed image 11-3 and the ideal reconstructed images 
11-6. 

[001 99] The reconstructed image 1 1 -3 and the ideal reconstructed 
20 images 11-6 can be calculated from the amount of positional deviation 11-2, 
the photographed image 11-1, and the ideal photographed images 11-5. 

[00200] 13-1 represents the positional relationship between the pixels 
of the photographed image and of the reconstructed image. The 
photographed image 13-2 of 3 x 3 pixels and the 2 x 2 pixels 13-3 of the 
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reconstructed image are in the positional relationship of being deviated by the 
amount of positional deviation 13-4. 

[00201] In this case, 13-5 shows a magnified view of the vicinity of a 
part of the pixels. 

5 [00202] 13-6 represents the photographed image, and it is considered 

with the pixels numbered from 10 through 13. 13-7 represents a pixel of the 
reconstructed image; a pixel deviation of 13-8 in the horizontal direction, and 
a pixel deviation 13-9 in the vertical direction are present. 

[00203] At this time, the values of the respective amounts of positional 

10 deviation, normalized by the pixel size, are taken as s and t, and the pixel 
values of each pixel 10 through 13 of the photographed image are taken 
respectively as v1 0, v1 1 , v1 2, and v1 3. In this case, the pixel value of the 
pixel 13-7 is obtained by the above-described Equation (1). 

[00204] It should be understood that, if distortion has occurred in the 

15 photographed image, it is possible to obtain the reconstructed image by taking 
account of this distortion in Equation (1). 

[00205] Then, the actual reconstructed image 1 1-3 which has been 
thus calculated is compared with the ideal reconstructed images 11-6, and 
thereby the code pattern is estimated. Specifically, for example, image 

20 matching is performed, the similarity is calculated, and comparison is 

performed based upon the result. Here, three methods will be explained for 
the method of calculating the similarity. The first is a method of calculating 
the similarity between the two images based upon the difference. When the 
pixel value for the pixel (x, y) of the actual reconstructed image 1 1-3 is termed 
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f(x, y), and the pixel value for the pixel (x, y) of the ideal reconstructed image 
1 1-6 of the code pattern Pt is gpt(x, y), then the similarity can be calculated by 
the Equation (2), described above. 

[00206] The code pattern Pt for which this value is minimum is taken 
5 as being the estimated pattern. In this case, it is effective to perform some 
type of normalization upon the actual reconstructed image or upon the ideal 
reconstructed images, since it may happen that unevenness in brightness or 
differences in brightness level may occur in the actual photographed image. 

[00207] The second is the method of calculating the similarity between 
10 the two images by normalization correlation. In the same way as in the case 
of calculating the similarity based upon the difference, if the pixel value for the 
pixel (x, y) of the actual reconstructed image 1 1-3 is taken as being f(x, y), 
and the pixel value for the pixel (x, y) of the ideal reconstructed image 1 1-6 of 
the code pattern Pt are taken as being gp t (x, y), then the similarity can be 
15 calculated from the above-described Equation (3). 

[00208] The code pattern Pt for which this value is maximum is taken 
as being the estimated pattern. It should be noted that it is not possible to 
utilize Equation (3) when the denominator of the Equation (3) becomes zero. 
[00209] The third is the method of calculating the similarity between 
20 the two images by correlation after having performed normalization for the 
average value and the standard deviation of the pixel values. In the same 
way as with the two methods described above, if the pixel value for the pixel 
(x, y) of the actual reconstructed image 1 1-3 is taken as being f(x, y), and the 
pixel value for the pixel (x, y) of the ideal reconstructed image 1 1-6 of the 
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code pattern Pt is taken as being gpt(x, y), then the similarity can be 
calculated by the above-described Equation (4). 

[00210] The code pattern Pt for which this value is minimum is taken 
as being the estimated pattern. It should be noted that it is not possible to 

5 take advantage of this method if Of or a gPt becomes zero. In this case, the 
method which employs the Equation (2) or the method which employs the 
Equation (3) should be taken advantage of (however, only in the case that the 
denominator of the Equation (3) does not become zero). 

[00211] Here, in the above-described three methods of calculating the 

10 similarity, if the code block consists of 3 x 3 pixels and the code area consists 
of 2 x 2 pixels, then the actual reconstructed image 1 1 -3 and the ideal 
reconstructed images 11-6 are images of 2 x 2 pixels. Accordingly, the range 
of x and of y for f (x, y) and gpt(x, y) are the range of 2 x 2 pixels. 

[00212] Generally, when the code block consists of m x n pixels and 

15 the code area consists of (m - o) x (n - p) pixels (where m and n are natural 
numbers, and o and p are natural numbers which satisfy 0<o<m and 0<p<n), 
the actual reconstructed image and the ideal reconstructed images are 
images of (m - o) x (n - p) pixels. Accordingly, the range of x and of y for f(x, 
y) and g Pt (x, y) are the range of (m - o) x (n - p) pixels. 

20 [00213] According to the method described above, even if the pitch 

and the position of the bright spots, or the size of the bright spots, or the 
brightness of the bright spots or the like is different, it is possible to calculate 
their ideal behavior, and accordingly the code pattern can be estimated. 
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[00214] As has been explained above, according to the information 
coding apparatus and the information decoding apparatus of this embodiment, 
when optical information recording is performed, specific pixel values are 
disposed between mutually adjacent code blocks. Accordingly, the beneficial 

5 effects can be obtained that it is easy to separate the code blocks, and that it 
is possible to code information which is to be recorded in a two-dimensional 
manner at a higher information density. 

[00215] Furthermore, according to the information coding apparatus 
and the information decoding apparatus of this embodiment, for the situation 

10 in which the minimum bright spot pitch of the coded image is less than or 
equal to 1 pixel, it is possible to estimate the code pattern which is recorded 
based upon the photographed image of the recorded image or its 
reconstructed image, and the ideal photographed images of the code patterns 
or their reconstructed images, so that it is possible to decode information 

15 which has been coded at a high density with good efficiency. 

[00216] The above-described information coding apparatus and 
information decoding apparatus internally comprise computer systems. 

[00217] In addition, the processes of the series of processes related to 
the above-described information coding process and information decoding 

20 process are stored in the form of programs upon a recording medium which 
can be read in by a computer, and the above-described processes are 
performed by these programs being read out by a computer and being 
executed. 
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[00218] In other words, the processing means and processing 
sections in the information coding apparatus and the information decoding 
apparatus are implemented by a central processing device (CPU) or the like 
reading out the above-described program in a main storage device such as a 
5 ROM or a RAM or the like, and executing the information processing and the 
calculation. 

[00219] Here, by a recording medium which can be read in by a 
computer, is meant a magnetic disk, an opto-magnetic disk, a CD-ROM, a 
DVD-ROM, a semiconductor memory or the like. Furthermore, it would also 

10 be acceptable to distribute this computer program to a computer via a 

communication line, and for the computer which has received this distribution 
to execute the program. 

[00220] It should be understood that the present invention is 
particularly effective in the case of application to a holographic memory or the 

15 like which makes a demand for a high density recording of information. 
However, the present invention is not to be considered as being limited 
thereto; it would be acceptable to apply it to general optical information 
recording and reproduction - for example, it might be applied to a two- 
dimensional bar code. 

20 

Industrial Applicability 
[00221] An information coding apparatus, an information decoding 
apparatus, and methods and programs for the same which are used for 
optical information recording and reproduction such as a hologram or the like 
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are provided. According to the present invention, even if the code blocks are 
arranged upon the two-dimensional image in any manner, the code areas are 
not disposed adjacent to one another, so that it is possible to separate these 
code blocks reliably. Furthermore, according to the present invention, since 

5 the information bits which are disposed in the areas of other pixels are already 
known, it is possible to perform the decoding reliably by applying 
compensation corresponding to this. Yet further, according to the present 
invention, it is possible to design the coding with a high degree of freedom, 
according to the needs of the user or the characteristics of the recording 

10 medium or the like. Even further, according to the present invention, it is 

possible to estimate the code pattern which is recorded, so that it is possible 
to perform decoding of the information which has been coded at high density 
with good efficiency. 
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